Comparing Automatic Simulator Assessment with Expert Assessment of Virtual Surgical Procedures
نویسندگان
چکیده
This study focuses on the comparison of expert assessment of virtual surgical procedures through Objective Structured Assessment of Technical Skills (OSATS) with the automatic assessment and feedback provided by a surgical simulator for hysteroscopic procedures. The existing multi-metric scoring system of the simulator was extended to include hysteroscopic myomectomy. The original OSATS was also modified for the examined surgical procedure. OSATS reliability, expert coherence, and interrater agreement with simulator feedback were investigated in a study with eight experts. The same selection of six movies showing virtual procedures performed at a hysteroscopy training course was rated by each expert. For the task-specific checklist, the reliability of the simulator was significantly higher than that of the individual human raters (p=0.006). In addition, the ranked order of the overall scores of all movies was the same for both simulator and expert consensus opinion. This is a first step to providing simulator feedback with the same reliability as an expert panel, thus facilitating competency-based surgical education and assessment in the near future.
منابع مشابه
A virtual reality simulator for teaching and evaluating dental procedures.
OBJECTIVES We present a dental training system with a haptic interface that allows dental students or experts to practice dental procedures in a virtual environment. The simulator is able to monitor and classify the performance of an operator into novice or expert categories. The intelligent training module allows a student to simultaneously and proactively follow the correct dental procedures ...
متن کاملIntelligent dental training simulator with objective skill assessment and feedback
OBJECTIVE We present a dental training simulator that provides a virtual reality (VR) environment with haptic feedback for dental students to practice dental surgical skills in the context of a crown preparation procedure. The simulator addresses challenges in traditional training such as the subjective nature of surgical skill assessment and the limited availability of expert supervision. ME...
متن کاملDevelopment and validation of a composite scoring system for robot-assisted surgical training--the Robotic Skills Assessment Score.
BACKGROUND A standardized scoring system does not exist in virtual reality-based assessment metrics to describe safe and crucial surgical skills in robot-assisted surgery. This study aims to develop an assessment score along with its construct validation. MATERIALS AND METHODS All subjects performed key tasks on previously validated Fundamental Skills of Robotic Surgery curriculum, which were...
متن کاملAssessment of skills using a virtual reality temporal bone surgery simulator
Surgery on the temporal bone is technically challenging due to its complex anatomy. Precise anatomical dissection of the human temporal bone is essential and is fundamental for middle ear surgery. We assessed the possible application of a virtual reality temporal bone surgery simulator to the education of ear surgeons. Seventeen ENT physicians with different levels of surgical training and 20 m...
متن کاملVirtual Reality Simulation in Laparoscopic Gynaecology
Background: Safe realistic training and unbiased quantitative assessment of technical skills are required for laparoscopy. Virtual reality (VR) simulators may be useful tools for training and assessing basic and advanced surgical skills and procedures. This study aimed to investigate the construct validity of the LapSimGyn VR simulator, and to determine the learning curves of gynecologists with...
متن کامل